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ABSTRACT 

Four  different  classes  of  adaptive  signal  cancelers  can  be 
used  to  eliminate  narrow-band  interference  from  a  broadband 
signal:  (1)  cascaded  second-order  notch  filters,  (2)  high-order 

in-line  notch  filters,  (3)  second-order  bandpass  noise  cancelers 
and  (4)  high-order  bandpass  noise  cancelers.  Of  the  four,  a 
structure  based  on  second-order  bandpass  filters  used  as  signal 
cancelers  is  found  to  perform  better  than  the  other  structures. 
The  adaptive  algorithm  for  these  filters  has  been  proposed  by 
Kwan  and  Martin  and  modified  by  Petraglia,  Mitra  and  Szczupak. 

The  Kwan  and  Martin  structure  can  be  reduced  in  hardware 
complexity  without  degrading  performance  using  a  new  adaptive 
algorithm  that  out-performs  any  of  the  other  known  structures  or 
algorithms.  This  new  structure  is  particularly  suited  to  the 
elimination  of  narrow-band  interference  in  broadband  Bi -Phase 
Shift-Key  (BPSK)  signals  with  and  without  background  noise. 


*Thi3  work  was  supported  in  part  by  the  United  States  Air  Force 


0.0  Introduction 

common  signal  processing  problem  is  the  reception  o^  a 
relatively  weak  broad-band  signal  such  as  a  spread-spectrum  Bi- 
Phase  Shi-ft-Key  (BPSK)  modulated  signal  in  the  presence  oi 
narrow^band  interference.  These  narrow-band  interferers  may  have 
less  energy  than  the  broad-band  signal,  but  because  it  is 
concentrated  over  a  narrow  bandwidth  they  mask  out  the  broad-band 
signal.  In  the  specific  work  that  we  are  interested  in,  the  goal 
is  to  eliminate  only  the  narrow-band  interference.  Later 
processing  will  separate  broad-band  noise  from  the  desired 
sign^.l.  However,  this  later  processing  will  not  work  properly 
unless  all  narrow-band  interference  is  eliminated  before  the 
broad-band  processing  is  begun. 

The  most  common  approach  to  eliminating  the  narrow-band 
interference  is  to  make  use  of  a  cascade  of  notch  filters  Cl-8]. 
Based  on  extensive  analysis  and  experimental  work,  Kwan  and 
Martin  developed  a  particularly  nice  structure  [51  which  was 
modified  by  Petraglia,  Mitra,  and  others  C7,B]  and  applied  with 
good  success.  However,  the  hardware  required  to  achieve  this 
performance  with  more  than  two  or  three  interfering  signals 
becomes  too  complex  for  easy  implementation,  particularly  when 
high  sampling  rate  is  required.  One  of  the  major  contributions 
of  this  report  is  to  introduce  a  modified  Kwan-Martin  algorithm 
that  maintains  the  performance  of  the  original  algorithm  but 
requires  substantially  less  hardware  for  elimination  of  narrow- 
band  interference  when  there  are  multiple  interferers. 

In  this  document  we  compare  several  approaches  to  elimination 
of  narrow-band  interference  from  broad-band  signals.  Sections  1 
describes  four  different  structures  for  adaptive  interference 
cancsl lation.  Section  2  compares  the  four  sections  and  gives  the 
basis  for  the  selection  of  the  second-order  band-pass  cancel er  as 
the  best  design.  Section  3  gives  detailed  information  on  the  new 
algorithm  for  the  second-order  band-pass  canceler  and  extensive 
experimental  data  to  demonstrate  its  advantages  over  other 
algorithms  including  the  algorithm  by  Kwan  and  Martin.  Section  4 
gives  detailed  examples  of  the  new  algorithm's  performance  in 
cancelling  narrow-band  BPSK  signals  in  the  presence  of  broad-band 
BPSK  signals  and  noise.  Conclusions  are  given  in  Section  5 
including  a  discussion  of  the  hardware  implementation  of  these 
filters.  Section  6  contains  the  references  for  the  report. 
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1.0  Adaptive  Notch  Filters 

Notch" filters  for  removing  multiple  narrow-band  interference  can 
be  categorised  into  four  broad  categories  illustrated  in  Figure 
1-1.  The  first  two  categories,  Figures  la  and  lb,  are  cascaded 
second  order  notches  with  each  second-order  section  removing  one 
frequency.  The  next  two  categories.  Figures  Ic  and  Id,  are 
higher-order  notches  that  eliminate  multiple  frequencies.  In  all 
of  the  categories,  it  is  possible  to  use  FIR  filters  (ie:  all 
zero  filters)  which  are  easily  pipelined  and  can  be  made  truly 
linear  phase.  However,  HR  filters  out  perform  FIR  filters. 

Thus  HR  pipelining  may  become  an  important  issue. 


1.1  Second-Order  Cascaded  Notch  Filters 

The  second-order  notch  filter  is  used  in  cascade  and  in-line 
with  the  signal  as  shown  in  Figure  1-la.  The  transfer  function 
for  the  notch  filter  is  given  by: 


Hh<2)  *= 

For  arbitrary  values  of  kj  and  kg,  this  is  a  symmetric  notch 
filter  with  unity  gain  at  DC  and  the  Nyquist  frequency.  If  kj  is 
kept  constant,  then  the  3db  notch  width  is  also  kept  constant. 
Thus  k^  may  be  adapted  to  remove  one  narrow-band  signal.  A 
cascade  of  such  filters  can  be  used  to  remove  multiple  narrow¬ 
band  signals. 
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1.2  Second-Order  Cascaded  Signal  Cancel er 

The  cascaded  second-order  signal  cancel er  approach  shown  in 
Figure  1-lb  has  the  advantage  that  the  desired  signal  does  not 
pass  through  the  adaptive  filter.  Instead,  the  band-pass  filter 
is  used  to  detect  the  narrow-band  signal  which  is  then  subtracted 
from  the  desired  signal.  A  constant  3db  bandwidth  notch  can  be 
achieved  by  selecting  a  band-pass  filter  with  the  transfer 
function: 
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Figure  1-1.  Four  Categories  o-f  Notch  Filters 
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where:  D(2)  is  the  same  denominator  as  H^(2)  in  equation  (1). 


The  signal-canceler  structure  is  also  nice  -for  adaptation 
because  it  is  relatively  easy  to  generate  sensitivity  -functions 
which  are  related  to  the  gradient  o-f  Hjp  with  respect  to  the 
•frequency  parameter  C5].  Figure  1-2  shows  the  block  diagram 
of  an  adaptive  version  of  this  filter.  The  sensitivity  function 
Hg (r )=Hpp(2)*H5 j (r)  where: 


H„(2> 


■s  s 


D(z) 


(1-3) 


The  parameter  kj  may  then  be  adapted  by  the  formula: 


kj  (n+1)  =  kj  (n)  -  tie  (n)s(n) 


Considerable  information  is  available  in  the  literature  on 
additional  second— order  notch  filters  Cl-8].  At  this  time, 
however,  the  two  discussed  here  seem  to  be  best  suited  for  our 

application. 


1.3  Higher-Order  In-Line  Notch  Filter 

The  notch  filter  of  Figure  1-lc  has  the  advantage  that  it  is 
more  easily  pipelined.  Such  a  filter  could  be  constructed  as  a 
line=i.r-pha5e  FIR  filter  which  is  easy  to  pipeUne  and  has  the 
advantage  of  linear  phase.  However ,  an  FIR  filter  will  require 
many  weights  to  obtain  good  performance. 

An  HR  in-line  filter  will  allow  good  performance  with  much 
fewer  weights.  However,  the  HR  filter  would  be  difficult  to 
make  adaptive.  Pipelining  the  HR  filter  is  more  difficult  than 
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pipelining  the  FIR  filter,  but  less  difficult  than  pipelining  the 
seccnd-order  HR  filter  of  the  last  section.  This  filter  could 
be  adapted  by  having  a  discrete  set  of  pre-selected  notches  which 
could  be  switched  in  by  a  detection  circuit  that  simply  looks  for 
ma);i,T\ums  in  the  spectrum  of  the  input  signal.  Although  this 
approach  could  be  used  with  any  of  the  filters,  it  is 
particularly  attractive  with  this  filter  due  to  the  ability  to 
generate  geometric  pole/zero  patterns  in  higher-order  filters. 


1.4  Higher-Order  Signal  Canceler 

The  signal  canceler  of  Figure  1-ld  has  most  of  the  same 
benefits  and  disadvantages  of  the  higher — order  in-line  notch 
discussed  above.  However,  since  the  canceler  is  not  in-line  with 
the  signal ,  the  desired  signal  does  not  need  to  pass  through  the 
filter.  Also,  it  may  be  easier  to  design  the  adaptive  portion  of 
this  filter.  An  additional  advantage  comes  from  the  ability  to 
adapt  the  filter  off-line  and  then  switch  it  in  once  the  filter 
is  able  to  enhance  the  performance  of  the  overall  system. 


1.5  HR  vs  FIR  Realizations 

In  our  case  of  narrow-band  interference,  the  second  order 
notch  of  section  1.1  and  the  second-order  band-pass  canceler  of 
sect  on  1.2  would  by  necessity  have  to  be  HR  realizations.  A 
second-order  FIR  filter  cannot  achieve  a  sufficiently  narrow 
band-width  in  order  to  adequately  handle  the  interfering  signals. 
Theoretically,  the  higher-order  realizations  of  sections  1.3  and 
1.4  could  be  either  HR  or  FIR.  However,  the  second-order  HR  is 
idea'ly  suited  for  our  situation  since  it  provides  a  sharp 
resonance  with  only  one  parameter,  the  notch  or  band-pass 
frequency,  to  be  adapted.  Higher  order  HR  filters  would  add 
grea‘-  complication  without  significantly  improving  performance. 

In  many  applications,  however,  it  may  be  advantageous  to  use 
FIR  rather  than  HR  filters.  FIR  filters  must  be  higher  order  in 
order  to  realize  the  narrow-band  characteristics.  The  two 
primary  advantages  of  the  FIR  realizations  are  that  they  can  be 
made  to  be  linear  phase  and  that  they  can  be  designed  using  the 
Discrete  Fourier  Transform  (DFT)  such  as  a  Fast  Fourier  Transform 
(FFT)  chip  or  a  Recursive  DFT  using  Residue  Number  Arithmetic 
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C9].  In  the  instance  o-f  section  1.3  an  N-th  order  m-notch 
adartive  in-line  notch  -filter  would  be  designed  using  one  of  the 
manv  FIR  design  techniques.  This  could  simply  be  an  adaptive 
linear  combiner  (ie:  tapped-delay-1 ine)  type  FIR  filter  or  some 
more  sophisticated  adaptive  design.  In  the  case  of  section  1.4 
we  would  use  the  DFT  implemented  with  an  FFT  chip  or  a  recursive 
DFT  to  produce  a  series  of  band-pass  filters  and  the  adaptive 
algorithm  would  simply  adapt  the  weights  of  the  output  subtracter 
that  would  cancel  the  various  sine  waves. 

Figure  1-2  shows  an  implementation  of  the  higher-order  FIR 
filler  of  section  1.4  using  the  recursive  DFT.  The  order  of  the 
FIR  filter  is  set  by  the  initial  delay  which  produces  N 
equally  spaced  zeros  around  the  unit  circle.  The  m  recursive 
pole  producing  sections  at  the  output  of  the  delay  z  are  used 
to  cancel  m  of  these  zeros  resulting  in  m  band-pass  filters. 

The?e  band-pass  filters  in  turn  cancel  the  narrowband 
interference  from  the  input  signal.  The  adaptive  algorithm  uses 
a  gradient  search  to  find  the  correct  zeros  to  cancel  in  order  to 
minimize  the  output  power  thus  cancelling  all  of  the  narrow-band 
interference. 


Figure  1-2. 


Adaptive  Recursive  DFT  FIR  Notch  Filter 


Figure  1-3.  Adaptive  IIR  Signal  Canceler 


2.0  Superiority  of  the  Second-Order  Bandpass  Canceler 

The  second-order  implementations  of  section  1.1  and  1.2  offer 
considerable  advantage  both  in  hardware  complexity  and  in 
adaptive  performance  when  compared  to  the  higher  ■o'^der 
realisations  of  sections  1.3  and  1.4.  A  tapped-delay-1 ine  type 
in-line  notch  filter  such  as  that  of  section  1.3  would  require 
over  10G  adaptive  weights  to  perform  as  well  as  a  10-weight 
second-order  filter.  Similarly,  a  higher — order  band-pass 
canceler  such  as  that  of  section  1.4  would  require  over  100 
weights  to  accomplish  comparable  performance. 

The  only  higher-order  section  that  appears  to  be  competitive 
with  a  second-order  system  is  that  of  Figure  1-2.  If  this  DFT 
approach  is  used,  a  delay  of  N>100  would  be  required  in  Figure  1- 
2,  but  the  adaptive  part  of  the  filter  can  be  made  comparable  to 
that  of  a  second-order  system.  In  terms  of  performance,  the  DFT 
approach  of  Figure  1-2  will  create  a  small  amount  of  passband 
rippJe  in  the  resulting  output  signal  y,  but  as  long  as  N  is  kept 
large,  this  ripple  should  not  be  a  problem.  Although  we  believe 
that  this  approach  deserves  further  attention,  our  experiments 
indicate  that  the  second-order  band-pass  canceler  approach  is  the 
best  choice  for  our  present  applications.  However,  future 
developments  in  real-time  DFT  hardware  or  developments  in  such 
areas  as  multi-level  Residue  Number  Arithmetic  hardware  for  the 
circuit  of  Figure  1-2  might  make  this  approach  attractive. 


2.1  Cascaded  Second-Order  Adaptive  Notch  Filters 

The  filter  of  section  1.1  was  implemented  and  tested  to  see  how 
it  performed  in  the  elimination  of  sine  waves  in  the  presence  of 
Gauseian  noise.  Initial  tests  indicated  that  the  cascade 
approach  performed  very  well.  However,  when  two  sine  waves  are 
close  together,  a  problem  arises.  Figure  2-la  shows  the  input 
used.  This  input  consists  of  3  sine  waves  at  O.lf^,  0.125fj,  and 
O.ST^'f,  (36°,  45°,  and  135°)  in  Gaussian  noise.  Each  sine  wave 
and  the  noise  have  the  same  energy  in  the  signal  (sine  waves  are 
amplitude  1.414  and  the  noise  is  Gaussian  with  variance  1.0). 
Figure  2-lb  shows  the  output  of  the  first  stage  of  the  notch 
filter,  Figure  2-lc  shows  the  output  of  the  second  stage,  and 
Fig  ure  2-ld  shows  the  output  of  the  third  stage  of  the  filter. 
Instead  of  eliminating  completely  one  sine  wave,  the  first 
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Figure  2-la.  Input  to  2nd-Grder  Cascaded  Adaptive  Notch 
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Figure  2-lb.  First  Stage  of  2nd-0rder  Cascaded  Adaptive  Notch 
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Figure  2-1 c.  Second  Stage  of  2nd-0rder  Cascaded  Adaptive  Notch 
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wav  Lt«Ln  '"iaure  2-lb)  centers  ItseH 

nrL^^'  ^  rather  than  eliminating  one 

ot  the -Bines.  Then  the  second  «nd  third  section  each  remove  one 
Of  tne  smes  leaving  the  third  sine  wave  untouched. 


2.2  The  Kwan  and  Martin  Filter 

In  a  recent  paper  by  Kwan  and  Martin  C53,  the  problem  o-f 
detecting  and  enhancing  sinusoidal  signals  in  the  presence  of 
nois:'  IS  addressed  wUh  a  cascade  of  IIR  adaptive  notch  filters 
which  are  used  to  eliminate  the  sinusoids.  Each  of  the  sinusoids 
is  eliminated  by  a  bandpass  filter  whose  output  is  an  enhanced 
version  of  one  of  the  sinusoids.  Hence  this  remarkable  structure 
can  oerform  both  tasks  with  a  single  adaptive  filter 
configuration  which  is  shown  to  be  highly  robust  and  performs 
extremely  well. 

The  major  disadvantage  of  the  Kwan  and  Martin  structure  is  that 
the  number  of  biquad  sections  needed  in  the  adaptive  filter 
configuration  is  given  by  N(N+3)/2,  where  N  is  the  number  of 
sinusoids  to  be  detected  and  removed.  This  becomes  impractical 
in  real-time  situations  with  more  than  4  sinusoids  due  to  the 
geometric  increase  in  the  required  hardware.  In  this  section,  we 
propose  a  modification  to  the  Kwan  and  Martin  structure  that 
reduces  the  required  hardware  to  3N-1  bi quads  with  no  effect  on 
the  performance  of  the  system. 


Ej(2) 


Figure  2-2.  One  Section  of  Kwan  and  Martin  Notch  Filter. 
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2.3  Kwan  and  Martin  Structure 

The  Kwan  and  Martin  structure  consists  of  a  cascade  of  HR 
notch  filters  one  stage  of  which  is  shown  in  Figure  2-2.  Each 
state  consists  of  a  bandpass  filter  with  zeros  at  DC  and  the 
Nyqiist  frequency  and  unity  gain  at  its  peak  frequency  Wj.  Such 
a  filter  would  have  the  following  z-domain  transfer  function: 

l-rj^  1  -  z"2 

HBpi(2>  = - j - —  (2-1) 

2  1  -  2riCosei  z"‘  +  rj^z"* 


where: 


rj  =  pole  radius  of  the  i-th  section 

6 1  -  2TT(i)j/U, 

Uj  =  peak  frequency  of  the  i-th  section 
=  sampling  frequency 


Kwan  and  Martin  identify  two  different  methods  for  adapting 
the  filter.  Most  of  their  derivation  is  based  on  what  they  call 
the  "constant  bandwidth"  filter  in  which  the  pole  radius  r|  is  a 
constant  and  only  the  frequency  Wj  is  adapted.  An  alternative 
approach  which  keeps  a  constant  Q  is  also  discussed  in  Kwan  and 
Martin.  Either  of  these  approaches  may  be  used  with  the 
structure  we  will  proposing,  although  we  too  have  chosen  to 
concentrate  on  the  constant  bandwidth  case  in  our  discussion.  In 
addition,  Kwan  and  Martin  select  the  adaptive  quantity  in  such  a 
way  -hat  it  is  fairly  easy  to  determine  the  notch  frequency  from 
the  adaptive  parameter.  For  simplicity,  we  have  not  followed 
this  approach,  but  have  chosen  the  adaptive  parameter  ki=cos5i. 
Substituting  this  into  equation  (2-1)  yields  the  following: 


1-r 


1  -  z 


-2 


HBPi(2)  = 


2  1  -  2riki  +  r,^z-^ 


(2-2) 


From  Figure  2-2,  we  see  that  the  notch  filter  for  each  section  is 
the  difference  between  1  and  the  bandpass  filter,  hence: 


H|^j(z)  =  1  —  Hbpj(2) 


(2-3a) 
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j  (2  )  = 


Hrj®  1  4kiri2"*/<l+ri*)  +  r** 


1  -  Srjkj  z"*  +  rjz 


-2 


'i 

(2-3b) 


CALCULATION  OF  THE  GRADIENT 

The  basic  structure  o-f  the  Kwan  and  Martin  adaptive  -filter 
shown  in  Figure  2-3  is  a  cascade  o-f  N  sections  of  the  form  of 
Figure  2-2. 


Figure  2-3.  Kwan  and  Martin  Notch  Filter  for  Tracking  N  sinusoids 
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The  overall  transfer  function  is  given  by: 


7(2)  =  IT  Hn:  (2) 

is: 


(2-4a) 


”i  =  l  ”  ^BPi ^ 


(2-4b) 


Kwan  and  Martin  choose  as  their  objective  function  J(2)  the 
square  of  the  output  of  the  final  stage  of  the  cascade: 


J(2)  =  CEi(2)3*  =  T(2)^X<2)* 


(2-5) 


Hence,  the  gradient  of  the  objective  function  J(2)  is  given  by: 


6J(z) 


dT(z) 


-  2E^<z)X(z) 


(2-6) 


Thus  in  order  to  find  the  gradient  with  respect  to  the  adaptive 
parameters  we  must  take  the  partial  derivative  of  T(2)  with 
respsit  to  each  kj: 

V 


61(2) 


(2) 


- =.ir  H,,i(2)  - 

5k,  dk. 

i/J  ^ 


(2-7) 


From  equation  (2-3a)  we  have; 


6HNj(2)  dCl  -  HBpj(2)]  -dHBp.(2) 


(2-8) 


-16- 


From  equation  (2-2)  we  have: 


dR„.(r) 


“  “Hj  pj  (z ) 


-2ri2’‘ 


D(z) 


=  H,p.(2)Hs.(z) 


(2-9) 


where: 


D(z) 


He:  (2) 

-  i 


-  2rjkj2“*^  +  C denominator  o-f  Mgpj<z)3 


2r  j2“* 

ir.k.z"  *  r. 


2r.z- 


D(z) 


Substituting  equation  (2-9)  into  equation  (2-7)  we  obtain: 


dT(z)  „ 

-  =.I[  H,,i(z)  Hpp.(2)Hs.(2) 

dk. 


(2-10) 


Figure  2-3  shows  the  Kwan  and  Martin  realization  o-f  the  complete 
adaptive  system.  The  di-f-ficulty  is  in  generating  the  product  o-f 
notch  -filters  without  the  notch  -filter  "j",  which  is  required  in 
equation  (2-10).  To  generate  this  product  -for  each  section, 
would  require  N-1  biquads  per  section  resulting  in  a  total  o-f 
N(N-l)  biquads  just  to  generate  the  product.  Kwan  and  Martin  are 
able  to  reduce  this  by  using  the  output  o-f  the  bandpass  filter  as 
the  input  to  their  cascade.  Since  this  output  already  has  (j-1) 
of  the  required  H^j(z)  factors  in  it,  only  (N-j)  additional 
bi quads  are  needed  for  a  total  of: 


•  •  •  ,  • 

')  (N-j)  *  ;  N  -  /  j  *  N*  - 


N*+N  N*-N 


(2-11) 
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Addir.Q  this  to  the  N  biouads  required  to  realize  the  cascade  O'f 
nbtcl  -filters  and  the  N  biquads  required  to  realize  the  Hg.fz) 
-factors  yields  a  total  number  o-f  biquads  given  by:  '* 

N^-N  N(N+3) 

M  of  bi quads  (Kwan/Martin)  =  -  +  2N  =  -  (2-12) 

2  2 


2.4  Improved  Structure 

Figure  2-4  shows  the  improved  adaptive  notch  filter  structure 
proposed  in  this  paper.  The  key  to  the  improvement  is  the 
recognition  that  the  output  (2>=T(2)X(2)  for  the  cascade  of  the 
notch  filters  can  be  written  both  as  a  product  of  the  individual 
notch  filter  section  transfer  functions  H^i(2>  time  the  input  and 
in  terms  of  the  input  X(2)  minus  the  outputs  Y|(2)  of  the 
bandpass  filters: 


Figure  2-4.  New  Notch  Filter  for  Tracking  N  sinusoids 
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(2-13a) 


Ei<2)  « 


T(2)X(2> 


N 

=  n 

i  St 


HNi<2)  X(2) 


N 


»  X(2)  -  )  Y:(2) 


<2- 13b) 


To  get  the  product  oi  H„j(2)  without  the  term  i=j,  we  may  use 
equation  (2-13b)  to  simply  add  back  the  term  Yj(2): 


IT  (2)  X<2)  =  T(2)X(2)  -  Y.(z) 
i  =  i  J 


(2-14) 


Figu’-e  2-4  makes  use  o-f  this  Tact  to  generate  the  gradient  needed 
■for  the  adaptive  process.  From  the  Figure,  we  can  see  that  the 
total  number  oT  bi quads  required  is  N  for  the  cascade  of  notch 
filters  plus  2N  for  the  H,p| (zlHgi (z)  required  for  adaptation, 
minus  1  at  the  last  stage,  since  the  last  stage  does  not  need  the 
extra  Thus  we  have: 


4  of  bi quads  (new  structure)  =  3N-1 


(2-15) 


Table  2-1  shows  a  comparison  of  the  number  of  bi quads 
required  for  the  Kwan  and  Martin  structure  vs  the  number  required 
for  the  new  structure  for  various  values  of  N.  As  can  be  seen 
from  the  table,  the  two  structures  are  very  competitive  for  N  up 
to  4,  but  beyond  N=4  the  new  structure  offers  a  considerable 
hardware  savings. 
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T*bl»  2-1 


N 

Kwan  and  Martin  Filter 
N(N+3)/2 

Proposed  Filter 
3N-1 

1 

2 

2 

2 

5 

5 

3 

9 

B 

4 

14 

11 

5 

20 

14 

6 

27 

17 

7 

35 

20 

8 

44 

23 

9 

54 

26 

10 

65 

29 

2.5  E^speri mental  Results  Using  the  New  Structure 

The  algorithm  was  compared  to  the  Kwan  and  Martin  algorithm 
and  -found  to  per-form  as  well  or  better  than  Kwan  and  Martin  in 
all  of  the  experiments.  Figure  2-5  shows  an  example  of  the  new 
algorithm  with  5  notches  applied  to  a  signal  with  5  sine  waves 
imbedded  in  noise.  Figure  2-5a  shows  the  input  signal  frequency 
response,  Figure  2-5b  shows  the  output  after  filtering  and  Figure 
2-5c  shows  the  frequency  response  of  the  output  after  filtering. 
Figure  2-5d  shows  the  adaptation  of  the  five  parameters.  Due  to 
computational  complexity,  we  were  unable  to  do  5  notches  using 
the  Kwan  and  Martin  algorithm,  thus  just  being  able  to  implement 
the  new  algorithm  represents  an  improvement  over  Kwan  and  Martin. 
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„  Fa  cure  2-6  shows  what  happens  when  the  5-notch  adaptive 
filter  IS  used  when  there  are  only  3  sines  imbedded  in’ noise. 
Figure  2-6a  shows  the  input  spectrum,  Figure  2-6b  shows  the 
outDut,  Figure  2-6c  shows  the  output  spectrum,  and  Figure  2-6d 
shows  the  adaptation  o-f  the  5  notches.  Three  of  the  notches 
cancel  the  three  sines,  while  the  remaining  notches  wander 
around. 

Figure  2-7  shows  what  happens  when  the  5-notch  adaptive 
filter  is  used  when  there  are  7  sines  imbedded  in  noise.  Figure 
2-7a  shows  the  input  spectrum.  Figure  2-7b  shows  the  output. 
Figure  2-7c  shows  the  output  spectrum,  and  Figure  2-7d  shows  the 
adaptation  of  the  5  notches.  What  happens  in  Figure  2-7d  is  very 
interesting  and  shows  just  how  robust  the  algorithm  is.  The 
first  4  notches  lock  solidly  on  the  first  4  frequencies  (30®, 

45®,  60®,  and  90®).  The  final  notch  is  left  jumping  between  the 
remcining  three  frequencies  (120®,  135®,  and  150®).  Since  it  is 
unable  to  cancel  all  three,  it  spends  a  little  bit  of  time  on 
each  one,  thus  attenuating  each  of  them.  Occasionally,  it  will 
scan  across  the  entire  range  in  hope  of  finding  a  better 
solution.  But  it  quickly  settles  back  to  the  pattern  of 
attenuating  each  of  the  remaining  sines. 

The  final  experiment  we  tried  with  the  sine  waves  is  shown  in 
Figure  2-B.  Here  we  used  10  notches  and  10  sines  in  order  to 
demonstrate  the  ability  of  the  algorithm  to  process  10  sine 
waves.  Figure  2-8  shows  the  adaptation  of  the  10  parameters. 


2.6  Conclusion 

We  have  demonstrated  that  the  new  adaptive  notch  filter 
structure  uses  considerable  less  hardware  than  the  structure 
proposed  by  Kwan  and  Martin,  yet  performs  the  same  (or  better)  in 
typical  applications.  In  addition  to  the  results  demonstrated 
here,  chapters  3  and  4  of  this  report  and  an  M.S.  Thesis  [10] 
provide  other  experiments  to  verify  the  performance  of  the  new 
structure.  This  work  has  also  been  reported  at  two  conferences 
[10,11].  In  all  of  these  cases,  the  new  structure  performs  as 
well  or  better  than  the  Kwan  and  Martin  structure. 
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Input  (5  sines  in  noise) 
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Figure  2-5a  Input  oi  5  Sines  <30®,  45®,  36®,  60®,  and  135®)  in  Noise 

step  =  0.100000,  5_limit  =  0.000000,  pmin  =0.000001,  pmax  =  1000000.00 
Number  o-f  sinusoidal  inputs  is  5;  AMP  =  {1.414,  1.414,  1.414,  1.414,  1.414> 
FREQ  =  {.083,  .125,  .167,  .250,  .375}  ANG  =  {0.0,  0.0,  0.0,  0.0,  0.0> 

DC  =  0.000,  NOISE  =  1.000,  kjimit  =  1.000,  slow  =  1,  n_sec  =  5 

Initial  values  o-f  kl  =  {0.000,  0.000,  0.000,  0.000,  0.000> 

Notch  pole  radii  =  {0.900,  0.900,  0.900,  0.900,  0.900> 

Second  order  -forgetting.  Factor  =  {0.900,  0.900,  0.900,  0.900,  0.900> 


6  56  106  156  266.  256  306  356  466  456  586 

Iterations 


Figure  2'-5b  Filtered  Output  5-Notch  Adaptive  Filter 

Input  3  Sines  (30°,  45°,  36°,  60°  and  135°)  in  Noise 

step  =  0.100000,  s^limit  =  0.000000,  pmin  =0.000001,  pmax  =  1000000.00 
Number  o-f  sinusoidal  inputs  is  5:  AMP  =  {1.414,  1.414,  1.414,  1.414,  1.414> 
FREQ  =  {.083,  .125,  .167,  .250,  .375>  ANG  =  {0.0,  0.0,  0.0,  0.0,  0i0> 

DC  =  0.00C,  NOISE  =  1.000,  k_limit  =  1.000,  slow  =  1,  n_sec  =  5 
Initial  values  o-f  kl  =  {0.000,  0.000,  0.000,  0.000,  0.000} 

Notch  pole  radii  =  {0.900,  0.900,  0.900,  0.900,  0.900} 

Second  order  -forgetting.  Factor  =  {0.900,  0.900,  0.900,  0.900,  0.900} 


Output  5-Notch  Adaptive  Filter  (5  sines  in  noise) 


Figure  2“5c  Frequency  Response  of  Filtered  Output  of  5-Notch  Filter 
Input  3  Sines  (30®,  45®,  36®,  60®  and  135®)  in  Noise 

step  -  0.103000,  sjimit  =  0.000000,  pmin  =0.000001^  pmax  ^  1000000.00 
Number  of  sinusoidal  inputs  is  5:  AMP  *  {1.414,  1.414,  1.414,  1.414,  1.414> 
FREO  «  {.083,  .125,  .167,  .250,  .375>  ANG  «  {0.0,  0.0,  0.0,  0.0,  0.0> 

DC  *  0.003,  NOISE  a  1.000,  kjimit  *  1.000,  slow  =  1,  n^sec  «  5 

Initial  values  of  kl  =  {0.000,  0.000,  0.000,  0.000,  0.000> 

Notch  pole  radii  *  {0.900,  0.900,  0.900,  0.900,  0.900) 

Second  order  forgetting.  Factor  »  {0.900,  0.900,  0.900,  0.900,  0.900) 
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Overlay  of  Parameiers  for  5-Hotch  Filter  (5  sines  in  noise) 
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Figure  2-5d  Parameter  Adaptation  oi  5-Notch  Filter 
Input  3  Sines  (30®,  45®,  36®,  60®  and  135®)  in  Noise 

step  -  0.100000,  s_limit  =  0.000000,  pmin  =^0. 000001,  pmax  -  1000000.00 
Number  of  sinusoidal  inputs  is  5:  AMP  =  {1.414,  1.414,  1.414,  1.414,  1.414> 
FRED  s:  {.083,  .125,  .167,  .250,  .375>  A 

DC  -  0.000,  NOISE  =  1.000,  kjimit 
Initial  values  of  kl  =  {0.000,  0.000,  0.0 
Notch  pole  radii  =  {0.900,  0.900,  0.900, 

Second  order  forgetting.  Factor  =  {0.900 


900,  0.900 


Input  (3  sines  in  noise) 


Figure  2-6a  Input  o-f  3  Sines  (30®,  36®,  and  135®)  in  Noise 

step  =  0.100000,  s_limit  =  0.000000,  pmin  =0.000001,  pniax  =  1000000.00 
Number  o-f  sinusoidal  inputs  is  3;  AMP  =  {1.414,  1.414,  1.414} 

FREQ  =  {0.0B3,  0.125,  0.375>  ANG  =  {0.000,  0.000,  0.000> 

DC  =  0.000,  NOISE  =  1.000,  k_limit  =  1.000,  slow  =  1,  n_sec  =  5 

Initial  values  o-f  kl  =  {0.000,  0.000,  0.000,  0.000,  0.000} 

Notch  pole  radii  =  {0.900,  0.900,  0.900,  0.900,  0.9001- 

Second  order  -forgetting.  Factor  =  {0.900,  0.900,  0.900,  0.900,  0.900} 
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Output  of  5-Hotch  Adaptive  Filter  (3  sines  in  noise) 
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Figure  2-6b  Filtered  Output  o-f  5-Notch  Filter 
Input  3  Sines  (30°.,  36°.,  and  135°)  in  Noise 

f 

step  =  0.130000,  sjimit  =  0.000000,  pmin  =0.000001,  pmax  =  1000000.00 
Number  o-f  sinusoidal  inputs  is  3:  AMP  =  {1.414,  1.414,  1.414} 

FRE(?  =  {0.083,  0.125,  0.375}  ANG  =  {0.000,  0.000,  0.000} 

DC  =  0.000,  NOISE  =  1.000,  k_limit  =  1.000,  slow  =  1,  n_sec  =  5 

Initial  values  o-f  kl  =  {0.000,  0.000,  0.000,  0.000,  0.000} 

Notch  pole  radii  =  {0.900,  0.900,  0.900,  0.900,  0.9003- 

Second  order  -forgetting.  Factor  =  {0.900,  0.900,  0.900,  0.900,  0.900} 
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Output  of  5-Notch  Adaptive  Filter  (3  sines  in  noise) 
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Figure  2-6c  Frequency  Response  o-f  Filtered  Output  of  5-Notch  Filter 
Input  3  Sines  (30°,  36°,  and  135°)  in  Noise 

step  =  0.100000,  s.limit  =  0.000000,  pmin  =0.000001,  pmax  =  1000000.00 
Number  of  sinusoidal  inputs  is  3:  AMP  =  {1.414,  1,414,  1.414> 

FREQ  =  {0.083,  0.125,  0.3751  ANG  =  {0.000,  0.000,  0.0001 

DC  =  0.000,  NOISE  =  1.000,  k_limit  =  1,000,  slow  =  1,  n_sec  =  5 

Initial  values  of  kl  -  {0.000,  0.000,  0.000,  0.000,  0.0001 
Notch  pole  radii  =  {0.900,  0.900,  0.900,  0.900,  0.9001 
Second  order  forgetting.  Factor  -  {0.900,  0.900,  0.900,  0.900,  0.9001 
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Iterations 


Figure  2-6cl  Parameter  Adaptation  for  5-Notch  Filter 
Input  3  Sines  (30°,  36°,  and  135°)  in  Noise 


step  =  0.103000,  s_limit  =  0.000000,  pmin  =0.000001,  pma>!  =  1000000.00 
Number  of  sinusoidal  inputs  is  3:  AMP  =  {1.414,  1.414,  1.414} 

FREO  =  {0.083,  0.125,  0.375}  ANG  =  {0.000,  0.000,  0.000} 


DC  =  0.000,  NOISE  =  1.000,  kjimit  =  1.000,  slow  =  1, 

Initial  values  of  kl  =  {0.000,  0.000,  0.000,  0.000,  0.000} 
Notch  pole  radii  *  {0.900,  0,900,  0.900,  0.900,  0.900} 

Second  order  "forgetting.  Factor  =  {0.900,  0.900,  0.900,  0.900 
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Figure  2-73  Input  o-f  7  Sines 
45®,  60®,  90°,  120®,  135®,  and  150®)  in  Noise 


Input  7  sines  (30 •  45,  60,  90,  120,  135,  S  150  deg)  in  noise 
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step  =  0.100000,  s_limit  =  0.000000,  pmin  =0.000001,  pmax  =  1000000.00 
Number  o-f  sinusoidal  inputs  is  7. 

AMP  =  {1.414,  1.414,  1.414,  1.414,  1.414,  1.414,  1.414} 

FREG  =  {0.083,  0.125,  0.167,  0.250,  0.333,  0.375,  0.417} 

AN6  =  {0.000,  0.000,  0.000,  0.000,  0.000,  0.000,  0.000} 

DC  =  0.000,  NOISE  =  1.000,  k_limit  =  1.000,  slow  =  1,  n_sec  =5 

Initial  values  o-f  kl  =  {0.000,  0.000,  0.000,  0.000,  0.000} 

Notch  pole  radii  =  {0.900,  0.900,  0.900,  0.900,  0.900} 

Second  orcer  -forgetting.  Factor  =  {0.900,  0.900,  0.900,  0.900,  0.900} 
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Figure  2-7b  Filtered  Output  o-f  5-Notch  Filter 
Input  7  Sines  (30%  45%  60%  90%  120%  135%  and  150® )  in  Noise 


>teo  =  0.100C00,  s_limit  =  0.000000, 
Number  o-f  sinusoidal  inputs  is  7. 

AMP  =  {1.414,  1.414,  1.414,  1.414, 

_  ^  ^  A  4  /  ^  n 


pmin  =0.000001,  pmax  =  1000000.00 
1.414,  1.414,  1.414> 


FREQ  =  tB.083,  0.125.  0.  U7 .  0.^^.  0.^1^, 


1.000,  slow  =  li 

0.000,  0.0OO1  0.000> 


n  sec  ®  5 


ANG  =  {0.000,  0.000,  0.000,  0.0000 
DC  =  0.000,  noise  =  1.000,  * 


Fiaure  2-1  z  Frequency  Response  O'f  Filtered  Output  o-f  5-Notch  Filter 
Input  7  Sines  (30°,  45°,  60°,  90°,  120°,  135°,’ and  150°)  in  Noise 

step  =  0.100000,  sjimit  =  0.000000,  pmin  =0.000001,  pma;;  =  1000000.00 

Number  o-f  sinusoidal  inputs  is  7. 

AMP  =  Cl. 414,  1.414,  1.414,  1.414,  1.414,  1.414,  1.414> 

FREE!  =  C0.083,  0.125,  0.167,  0.250,  0.333,  0.375,  0.417)- 

AN6  =  C0.000,  0.000,  0.000,  0.000,  0.000»  0.000,  0.000> 

DC  =  0.000,  NOISE  =  1.000,  kjimit  =  1.000,  slow  =  1,  n_sec  =  5 

Initial  values  o-f  kl  =  {0.000,  0.000,  0.000,  0.000,  0.000) 

Notch  pole  radii  =  {0.900,  0.900,  0.900,  0.900,  0.900) 

Second  order  forgetting.  Factor  =  <0.900,  0.900,  0.900,  0.900,  0.900) 


OuerlAu  of  Paraneters  (IB-notch  filter  with  IB  sines) 


iterations 

Figure  2-B  Input  of  10  Sines  in  Noise 
(30®,  36%  45%  60%  72%  108%  120%  135%  144%  150*  > 


step  =  0.100000,  s_li?nit  =  0.000000,  pmin  *0.000001, 
Number  ot  sinusoidal  inputs  is  10. 

AMP  =  Cl. 414,  1.414,  1.414,  1.414,  1.414,  1.414,  1-414, 

FRED  =  {0.0E3,  0.100,  0.125,  0.167,  0.200,  0.300,  0.333, 

ANG  =  <0.0G0,  0.000,  0.000,  0.000,  0.000,  0.000,  0.000, 

DC  *  0.000,  NOISE  =  0.000,  k_limit  *  1.000,  slow  * 


pmax  *  1000000.00 

1.414,  1.414,  1.414> 
0.375,  0.400,  0.417> 
0.000,  0.000,  0.000> 
1,  n_sec  *  10 


{0 . 000 , 


Notch  pole  radii  = 

{0.900,  0.900,  0.900,  0.900,  0.900, 
Second  order  -forgetting.  Factor  * 
{0.900,  0.900,  0.900,  0.900,  0.900, 


0.900,  0.900,  0.900,  0.900,  0.900} 
0.900,  0.900,  0.900,  0.900,  0.900} 


3.0  Detiiltd  Dticription  of  tho  N»vi  Algorithm 


In  this  chapter  of  the  report  we  will  discuss  in  detail  the 
new  algorithm  and  demonstrate  its  performance  on  simulated  data. 
The  derivation  of  the  structure  and  the  gradient  calculation  were 
discjssed  in  sections  2.3  and  2.4.  Here  we  shall  give  the 
details  for  implementing  the  adaptation,  information  on  how  to 
choose  the  various  adaptive  parameters,  and  demonstration  of  the 
effects  of  different  choices  on  the  performance  of  the  filters. 


3.1  The  Adaptation  Algorithm 


Figure  2-4  gives  the  structure  for  the  new  algorithm.  The 
structure  contains  two  types  of  second-order  filters: 


Band-pass  filters  (see  equation  2-2): 


1-r : 


1  -  z 


-2 


Hjp:  (z)  = 


2  1  -  2rikj  z"‘  +  rj^z"* 


(3-1) 


and  Sensitivity  filters  (see  equation  2-9) 


Hs.(2)  = 


2r.r-‘ 


2rjr 


-1 


1  -  2r  +  r  D(z> 

V  V  V 


(3-2) 


where: 


D(2)  =  1  -  2rjkjZ"‘  +  Tj"*  [denominator  of  H|pj(z)3 
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The  partial  derivative  is  given  by  (see  equation  2-10)! 


6T(z)  ^ 

-  =  -.J^H^i(2)  H,p^(2)Hs.(2) 


(3-3) 


The  only  parameter  that  is  modified  in  the  adaptation  process 

is  the  pole  cosine  k.  -for  each  bandpass  filter  section  j.  This 

parcmeter  also  effects  the  denominator  of  the  sensitivity  filter 

H,;(2).  The  only  other  parameter,  r^,  is  fixed.  Selection  of  r j 

will  be  covered  in  section  3.3.  The  standard  LMS  algorithm  would 

give  us  the  following  update  procedure  for  adapting  k-: 

¥ 

dT(z) 

k,'  =  k;  -  iLe.(2) -  (3-4) 

'  '  '  dk  i 

4 

where:  is  a  fixed  step  size  (typically  a=0.1) 


As  derived  in  chapter  2,  the  correct  choice  for  the  error 
function  e(2)  is: 


c.  (z)  =  T(z)  (for  all  j)  (3-5) 

4 

However,  an  alternative  choice  which  can  be  derived  by  forming 
the  gradient  of  the  section  outputs  Yj(z)  is: 

ej(2)  =  Y.(2)  <3-6) 


Both  of  these  choices  for  Bj(z)  were  tested  and  found  to  work 
well. 

A  word  of  explanation  is  in  order  here.  Equation  (3-4)  seems 
to  imply  that  we  are  mixing  z-domain  and  time  domain  terms.  In  a" 
sens?,  we  are.  The  derivative  are  taken  on  the  frequency  domain 
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teres,  but  the  outputs  labeled  dT(2)/dkj  in  Figure  2“4  are 
actually  time  series.  It  is  these  time  series  that  are  used  in 
equation  (3-4).  Also,  the  output  is  really  the  time  series 

yj(i).  This,  o-f  course,  implies  that  we  are  using  instantaneous 
values  to  represent  the  actual  values,  thus  these  are 
approximations  to  the  actual  values. 


3.2  Forgetting  Factor 

Use  of  the  instantaneous  values  as  discussed  in  section  3.1 
does  not  result  in  a  very  robust  adaptation  algorithm.  One 
Solution  to  this  problem  is  to  dynamically  adjust  the  step  size 
II.  The  justification  for  this  and  the  mathematical  derivation  of 
the  "forgetting-f actor"  concept  is  well  known  (eg:  see  C5]).  In 
orde‘-  to  test  various  forgetting  factors,  we  employed  the 
following  update  equation: 


l:jCk]:=kjCk]-step*gradient*  (1.0+pCk,0]/pmax)  /  (pmin+pCk,0]) 


where; 


step  =  a  (fixed  for  a  particular  structure) 

(3-7a) 

aT(z) 

gradient  =  ei(z) - 

(3-7b) 

8k. 

pCk,0]  =  output  of  forgetting 

filter 

(3-7c) 

pmax  =  limits  the  effect  of 

large  p[k,0] 

(3-7d) 

pmin  =  limits  the  effect  of 

small  pCk,0] 

(3-7e) 

NOTE: 

We  found  that  pmax  and  pmin  were  not  required  so  in  reality 
the  update  algorithm  could  be  replaced  by: 
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r:jCI;]:=l<jC»;]-step*gradient/pCk,0] 


(3-B> 


However,  all  of  the  data  in  this  chapter  Mas  run  with  equation  7 
setting  pmax-1000000  and  pminB0. 000001, 

Three  different  forgetting  filters  were  tested.  The  first, 
called  zero-order  forgetting,  uses  the  sum  of  the  squares  of  the 
instantaneous  outputs  bJ (z) /6k ^  as  pCk,0D.  The  next,  called 
first  order  forgetting,  is  a  simple  single-pole  first  order  low- 
pass  filter  applied  to  the  section  output  Cai  (z ) /ak j 3^ .  The 
third  type,  called  second-order  forgetting,  is  a  second-order 
low-pass  filter  applied  to  CdT(2) 


Zero  Order  Forgetting 


pCk,0] 


dT(2) 


12 


(3-9a) 


First  Order  Forgetting 


pCk,0] 


(1-r^) 


aT(2) 


d\u 


2 

+ 


r^pCk,03 


(3-9b) 


Second  Order  Forgetting 


pCk,0]  =  output  of  one  of  the  following  second-order  filters 
with  input  CdT(z) /dk ^3^: 
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Simple  2nd-0rder  Low-Pass 


(2) 


hj  < 1  -  22“^  +  2"*) 
1  -  2r^k.z~^  +  2'* 


(3-9c) 


Complex  2nd-0rder  Low-Pass 


H^(2) 


hjd  -  2cos<Sfij)2“*  +  2“*) 


1  - 


2r,k.2 


-1 


+  2 


-2 


where:  6-  =  ArcCos(k.) 

V  « 


(3-9d) 


The  -filter  o-f  equation  (3-9d)  was  used  by  Kwan  and  Martin  C53, 
3.3  Selection  of  Notch  Bandwidth 

Each  bandpass  filter  has  a  fixed  bandwidth  set  by  the 
parameter  rj.  If  we  let  x  be  the  lower  3db  frequency  of  the 
notch  and  y  be  the  upper  3db  frequency  of  the  notch,  then  the 
bandi-'idth  is  d  =  x  -  y.  We  shall  first  calculate  d  at  the 
frequency  2=j  (90®,  Then  we  shall  calculate  x  and  y  for 

other  values  of  k.  based  on  the  fixed  d. 

4 

When  kj=0  we  can  solve  for  the  two  3db  frequencies  x,  and  y^ 
from  the  following  equation: 


‘  1+r*  ' 

2 

(l+cos2ut)*  +  sin*2ut 

2 

< l+r*co52ut ) *  +  r^sin*2ut 

<3-10a) 


1 


'  1  +  2r®  +  r^ ' 

4  +  4cos2(i)t 

4 

(1  +  2r®co52(i)t  + 

(3-10b> 
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cross-multiplying  yields:  • 


l+2r*cos2wt+r^  =  l+2r®+r^  cos2ut  ( l+2r*+r^)  (3-11) 

Using  the  fact  that  coB2ut  =  2cos^«t-l,  Me  solve  equation  (3-11) 
■for  coswt: 


cos2<i>t  =  2cos*ut 


l-r‘ 


cosot  =  ± 


2(l+r^) 


(3-12a) 


(3-12b) 


Since  is  the  lower  3db  -frequency  and  y,  is  the  upper  3db 
■frequency,  we  have: 


X0  =  ArcCos 


-d-r*) 


4^ 


(l+r^) 


(3-13a) 


Yb  =  ArcCos 


1 


(1+r^) 


(3-13b) 


Also,  since  5in^6>  +  cos^e  =  1 ,  we  have: 


1-r' 


cos(x,)  =  - 


2(l+r^) 


(3-14a> 
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(3-14b) 


l-r* 

cos(yg)  s  +  - 

-J  2(l+r^) 

l+r* 

sin(Xj)  =  +  - - 

4  2(l+r^) 

1+r® 

sin(y,)  =  +  - 

■I  2(l+r^) 


(3-14C) 


(3-14d) 


We  rr.ay  how  calculate  the  bandwidth  d  from  d  =  x*  -  y^; 
cos(d)  =  cos(Xj-y^) 

=  cos(x4)co5(ye)  +  sin(xg)sin(y,)  (3-15) 

Substitution  from  equations  (3-14)  into  equation  (3-15)  yields: 

-(l-2r*+r^)  +  (l+2r*+r^)  2r® 

cos(d)  =  -  =  -  (3-16) 

2(l+r^)  1+r^ 


Although  we  have  calculated  d  for  the  specific  case  of  a  notch  at 
2=j  (90®),  d  is  constant  at  all  frequencies.  In  general  the 
notch  frequency  z=e''^=co5(/r)+jsin(/7)  for  any  section  can  be 
calculated  as  follows: 


0 


<3- 17a) 


2rk.2"^  + 


r 


l+r 


2  1 


4rk. 

— i- 

l+r* 


=  0 


{3-17b) 


Substituting  -for  2=e''^=cos(/r)+jsin (/r)  in  equation  <3-17b)  and 
setting  the  real  and  the  imaginary  part  to  zero  yields: 


4r  k  . 

1  -  -  cos(/r)  +  cos(2/r)  =  0  (3-lBa) 

l+r* 


4rk  j 

-  sin</r)  +  sin(2/r)  =  0  (3-1  .r 

l+r* 


Using  trigonometric  identities: 


4rk  j 

1  -  -  co5(/r)  +  2cos*(/r)  -1=0 

l+r* 


<3-19a) 


4rk. 


l+r‘ 


sin(/r)  +  2sin (/r)cos(/r)  =  0 


(3-19b) 


both  equations  yield  the  same  result: 


cos(/r) 


2rk 


l+r 


1 

2 


(3-20) 
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Note  that  the  notch  -frequency  is  only  slightly  dif-ferent  -from  the 
pole  -frequency  determined  by  kj=cos(e).  I-f  r=l,  the  two 
•freqwiencies  would  be  identical.  0-f  course,  -for  stability,  r  must 
be  1-?S5  than  one.  Table  3-1  lists  the  relationship  o-f  d  to  the 
value  of  r.  From  the  table  we  see  that  values  of  r  around  .9  are 
well  suited  to  the  type  of  notches  needed  to  eliminate  narrow- 
band  interference.  The  table  also  lists  the  measured  values  for 
the  actual  notch  frequency  /,  the  lower  3db  frequency  x,  and  the 
upper  3db  frequency  y  for  each  of  the  notches.  These  compare 
closely  to  the  calculated  values  in  equation  (3-16),  equation  (3- 
20) ,  and  as  follows: 


Table  3-1  Effect  of  r  on  Notch  Width 


r 

e 

X 

/ 

y 

d 

0. 300 

0 . 083 

0.093 

0.171 

0.314 

0.221 

0. 300 

0.167 

0.123 

0.206 

0.344 

0.221 

0.300 

0.250 

0.163 

0.250 

0.384 

0.221 

0.500 

0.083 

0.068 

0.128 

0.240 

0.172 

0. 500 

0.167 

0.118 

0. 185 

0.290 

0.172 

0 . 500 

0.250 

0.178 

0.250 

0.350 

0.172 

0.700 

0.083 

0.059 

0.099 

0.164 

0. 105 

0.700 

0. 167 

0.127 

0. 172 

0.232 

0.105 

0.700 

0.250 

0.203 

0.250 

0.308 

0.105 

0.  R00 

0.0R3 

0,062 

0.090 

0.131 

0.069 

0.800 

0. 167 

0. 138 

0. 169 

0.207 

0.069 

0.800 

0.250 

0.218 

0.250 

0.287 

0.069 

0.900 

0.083 

0.070 

0.085 

0.103 

0.033 

0.900 

0.167 

0.151 

0.167 

0. 185 

0.033 

0.  900 

0.250 

0.234 

0.250 

0.267 

0.033 

0.950 

0.083 

0.076 

0.084 

0.092 

0.016 

0.950 

0. 167 

0. 159 

0.167 

0. 175 

0.016 

0.950 

0.250 

0.242 

0.250 

0.258 

0.016 

-43- 


<3-21a) 


y  -  X  *  d 

“V  =  (3-21b) 


hence: 


y*  -  xy  -dy  =  y®  -  -f*  -dy  =  Q 


(3-22a> 


y  =  d/ 


2  +  -I 


(d/2)*  + 


X  *  d/2 


-■[ 


(d/2)*  +  /*  (3-22b) 


3.4  Minimum  and  Maximum  Frequency  o-f  Notch 

Equation  (3'-20)  implies  that  the  notch  -frequency  is  slightly 
di-f-ferent  -from  the  pole  -frequency  9,  In  particular: 

2rk.  2r 

cos(/7)  =  -  =  -  cos(S)  (3-20) 

1+r*  1-fr* 


This  difference  becomes  smaller  as  r  approaches  one.  However,  if 
the  pole  frequency  9  is  at  its  minimum  of  0®,  then  kj=l  and: 


^  =  fr 


=  ArcCos 


a  =  0 


2r 

1+r* 


(3-21a) 


If  9  is  at  its  maximum  of  tt  (1B0®),  then  kj®-l  and: 


n 


L  -  fr 


=  ArcCos 


9-"n 


-2r 

1+r* 


(3-21b) 


From  equation  (3-20)  we  see  that  the  difference  between  the  notch  * 
frequency  /r  and  the  pole  frequency  5  is  at  most  As  9 
approaches  Tr/2  (90®),  the  difference  between  the  notch  and  pole 
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frequencies  goes  to  zero.  Table  3-1 1  gives  A  and  180®-Z!i  for 
various  values  of  r. 


Table  3-1 1  Effect  of  r  on 


The  maximum  and  minimum  notch  frequencies  given  in  Table  3-1 I 
are  important  because  if  there  is  a  sinusoid  at  a  frequency  lower 
than  the  minimum  notch  frequency  or  if  there  is  a  DC  value,  the 
notch  will  be  forced  to  this  minimum  frequency.  Similarly,  if 
there  is  a  sinusoid  above  the  maximum  frequency  or  at  the  Nyquist 
frequency,  the  notch  will  be  forced  to  this  maximum  frequency. 
Figure  3-1  shows  the  result  of  a  DC  signal  on  the  adaptation 
process.  The  notch  is  forced  to  6.02558°  in  this  case  because 
the  radius  of  the  notch  filter  is  chosen  as  r=0.9.  Similarly, 
Figure  3-2  shows  a  signal  at  the  Nyquist  frequency  forcing  the 
notch  to  the  maximum  frequency  of  173.99442°. 


3.5  Algorithm  Performance 

Critical  to  the  performance  of  the  algorithm  is  the  choice  of 
various  parameters: 


1»  Number  O'f  notch  f liters ^ 

2.  Notch  width  r^, 

3.  Zero,  first,  or  second-order  forgetting  (or  none). 

4.  Step  size  a, 

5.  Limit  on  the  parameter  k,  and 

6.  Limit  on  the  parameter  p. 

The  first  three  choices  are  somewhat  independent  of  each  other. 
But  the  choice  of  the  step  size  ti  is  highly  dependent  on  the 
first  three  choices.  We  found  that  limiting  k  such  that  -15k. <1 
was  very  important  in  all  cases.  However,  we  found  that  limits 
on  p  were  not  very  useful . 

The  choice  of  the  number  of  notch  filters  has  a  profound 
effect  on  the  algorithm  performance,  but  is  assumed  to  be  out  of 
our  control.  We  assume  that  the  number  of  notches  is  fixed  at 
some  number  by  the  application.  Thus  in  evaluating  the 
algorithm,  we  look  at  three  cases: 

Case  1:  Performance  with  only  one  notch. 

Case  2:  Performance  with  five  notches, 

Case  3;  Performance  with  ten  notches. 

Table  3-1 I I  summarizes  experiments  with  the  new  algorithm. 
For  these  experiments,  the  following  10  frequencies  were  used: 


1. 

= 

0.08333  f. 

(30®) 

o 

0.1  f. 

(36®) 

^in 

= 

0.125  f. 

(45®) 

4. 

^in 

0.1667  f. 

(60®) 

5. 

= 

0.2  f. 

(72®) 

o. 

^in 

S 

0.25  f. 

(90®) 

•7 

• 

= 

0.3  f. 

(108®) 

8. 

s 

0.3333  f. 

(120®) 

9. 

^in 

= 

0.375  f. 

(135®) 

10. 

s 

0.4  f. 

(144®) 

In  cases  where  only  one  frequency  was  selected,  the  results 
are  based  on  the  results  with  each  of  the  5  frequencies  (1,  3,  6, 
6,  IS)  taken  separately.  In  cases  where  three  frequencies  were 
used,  the  following  five  combinations  were  used  {(1,2,6), 
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n,-,10),  (1,9,10),  (6,9,10)}.  When  5  'frequencies  are 

selected,  we  used  the  6  combinations  of  the  following  6 
frequencies  (1,  3,  4,  6,  B,  and  9)  taken  5  at  a  time. 


3.5  Conclusions 

Table  3-1 V  shows  the  results  of  these  experiments.  From 
these  results,  we  conclude  that  a  forgetting  factor  is  needed  for 
multi-notch  filters  and  that  a  second-order  forgetting  factor 
does  not  seem  to  inprove  the  performance  over  a  first-order 
factor  which  seems  to  work  quite  satisf actorilly.  The  first- 
order  forgetting-f actor  is  the  only  one  that  does  not  exhibit 
“jump"  convergence.  Here  we  refer  to  "jump"  convergence  as  the 
situation  when  there  are  more  interferers  than  notches  and  the 
last  notch  in  the  cascade  “jumps"  between  the  remaining 
frequencies  to  be  eliminated.  This  "jump"  convergence,  might 
actually  be  desireable  in  some  instances,  in  which  case  one  would 
want  to  avoid  the  first-order  forgetting  factor. 

A  word  should  be  given  about  the  zero-order  forgetting.  For 
this  case  alone,  the  parameters  p.j,,  and  p^^^  w®*"® 
default  values  of  p„jn*0. 000001  and  1000000.  For  zero-order 

forgetting,  it  is  necessary  to  have  specific  values  for  p^j^  and 
Pmax  order  to  obtain  convergence.  The  “Limit  on  p  value" 
column  in  the  table  gives  the  required  limits  to  obtain 
convergence  for  the  zero-order  forgetting  factor.  It  should  be 
kepi  in  mind  that  this  column  applies  ONLY  to  the  zero-order 
forgetting  factor  data.  All  other  data  was  obtained  with  the 
deffult  values  for  p,, and  p^ay  It  also  should  be  noted  that 
limits  on  p„,  Pmax  other  forgetting  factors  can 

improve  performance,  but  at  the  cost  of  a  more  comples  update 
algorithm. 


Table  3- IV  Summary  of  Tests  on  New  Algorithm 


Case 

(  se=s 

I 


la  1 


Ian  1 


lb  1 


2an  5 


2bn  5 


2c  5 


2cn  5 


3a  10 


3dn  10 


3b  10 


Limit  on  No  Zero-Order  Ist-Order  2nd-0rder 

p  value  Forgetting  Forgetting  Forgetting  Forgetting 

Sines  — —  — Noise  i 

Pain  Paax  ^  iter  a  iter  a  iter  a  iter 


1  0.05  20  NO  .02  50  .05  67  .05  20  .05  20 


1  0.05  20  YES  .02  50  .05  Jump  .05  20  .05  144 


3  0.05  20  NO  .02  700  .05  Jump  .05  30  .05  25 


Ibn  1  3  0.05  20  YES  .02  750  .05  Ijumpl  .05 


3  0.10  10  NO  1.46  2500  .017  340  .063  200  .07  400 


.10  10  YES  1 1.46  150  .017  1200  .063  400  .07  450 


5  0.10  10  NO  1.46  325  .017  1410  .063  150  .07  5 


5  0.10  10  YES  1.46  3120  .017  3500  .063  175  .07  250 


0.10  10 


0.10  10 


0.02  50 


0. 


YES  1.46  9500  .02  5 


Si 


0  NO  1.46 


10  0.02  50  YES  1.46  1000  .02  1000  .075  2000  .07  2500 


100 

.07 

400 

.07 

450 

.07 

m 

.07 

250 

.07 

Jump 

.07 

Jump 

.07 

1500 

.07 

1000 

.07 

5250 

.07 

2500 

1.  In  all  cases  without  noise,  parameters  converge  to  exact  value  when  number 
of  notches  is  greater  or  equal  to  number  of  sines.  Iterations  listed  in 
table  represent  convergence  to  three  decimal  places  of  correct  value. 

2.  In  all  cases  with  noise,  parameters  oscillate  around  exact  value.  The 
number  of  iterations  listed  in  the  table  is  the  number  of  iterations 
required  to  establish  this  oscillatory  pattern. 


-48- 


3.  In  sone  cases  with  more  interfering  sine  waves  than  notches,  the  notches 
will'  jump  at  random  between  sine  waves.  This  pattern  is  indicated  in  the 
table  by  the  word  "Jump". 

4.  Values  o-f  p.^^  Paax  table  refer  only  to  zero-order  forgetting 

which  generally  will  not  converge  without  limits  on  p.  All  other  types  of 
forgetting  were  run  without  limits  on  p  (iet  p,i„«l0"*  and 
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4.0  Algorithm  Per-formance  and  Simulation 

The  adaptive  digital  -filter  algorithm  as  described  in  the 
earner  chapters  is  simulated  and  tested  using  synthetic  data. 
Similation  was  carried  out  on  VAX  11/785  computer  using  Fortran 
77.  The  synthetic  data  generated  -for  testing  this  algorithm  is 
o-f  -four  categories; 


1.  Sinusoidal  signals  with  white  gaussian  noise 

2.  Narrow  Band  Noise  with  white  gaussian  noise 

3.  Bi-Phase  Shi-ft  Keying  (BPSK)  sequence 

4.  Frequency  Shi^t  Keying  (FSK)  sequence 


4.1  Sinusoidal  signals 

For  generating  sinusoidal  signals  placed  at  di-f-ferent 
normalised  -frequencies  a  second  order  AR  process  given  as: 


V 

4  \ 


i 


k 


2cos (6 j ) 


k-1 


V 


k-2 


(4-1) 


was  used  with  poles  on  the  unit  circle.  This  approach  was  chosen 
in  order  to  reduce  the  computational  burden.  Using  equation  4-1, 
we  -find  that  initial  conditions  are  very  important  and  they  are 
chosen  such  that  and  ;;_2=”sin (5 ^ )  giving  a  unit  amplitude 

sinusoidal  signal.  The  9^  value  is  between  0  to  180  and  n  is  the 
number  o-f  -frequencies  desired.  The  required  signal  y^  needed  to 
input  into  the  adaptive  algorithm  is  given  as: 


i  =n 


in 


(4-2) 


where  is  a  white  gaussian  noise  N(0,(r^). 
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4.2  Narrow  Band  Noise 

The  narrow  band  signal  is  generated  using  the  difference 
eqi+ction: 


i 

K 


2rcos(fl|  )z 


k-l 


r 


2..i 

A 


k-2 


+ 


(4-3) 


where  6 decides  the  placement  of  the  noise  in  the  spectrum  and  r 
controls  the  band-width  of  the  noise.  The  u\  is  simply  a 
uniformly  distributed  noise  taken  at  different  instants.  The 
desired  signal  y„  is  obtained  via: 


i 


n 


Yk 


i  =  1 


(4-4) 


4.3  Bi -Phase  Shift  Keying  Sequence 

The  generation  of  BPSK  signal  has  distinctly  three  parts  which 
are  generated  as  shown  in  Figure  4-1.  The  three  parts  are  as 
follows: 


X.  Generation  of  the  Random  Binary  Sequence (RBS)  is  achieved 
by  passing  a  uniformly  distributed  noise  through  a  hard 
limiter.  (An  important  note  is  that  the  interval  between 
the  two  consecutive  bits  of  RBS  is  l//|j.) 

2.  Generation  of  another  sequence  of  binary  numbers  which 
are  in  practice  a  spreading  code  or  spreading  sequence. 
The  specific  sequence  used  in  a  given  communications 
system  is  normally  not  available  to  anyone  but  the 
intended  receiver.  (In  this  particular  simulation  we 
have  generated  the  spreading  sequence  by  passing  a 
uniformly  distributed  noise  through  a  hard  limiter.  The 
bit  interval  is  1//^.) 

3.  Generation  of  the  phase  encoding,  ie:  the  mapping  of  the 
given  binary  signal  which  is  the  excJusii'e  or  of  (1)  and 
(2)  above  into  either  0  or  tt  at  appropriate  sample  times. 
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DSSS  BPSK  Generator 


Uniform 
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Number 


♦ 

- 

0.6 
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X(i) 


X(i) 


Pulse 

Expansion 


(I  •  kf  ) 


1 

a 

IE 

nQQmMi 

Fig.  4.1 


Figure  4-1.  Generation  o-f  the  BPSK  Signal. 
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The  output  of  the  first  hard  limiter  is  stored  in  an  array  k 
(see  Figure  4-1).  Output  of  the  second  hard  limiter  is  stored  in 
the  array  y.  This  information  is  retrieved  by  a  subtle  use  of 
the  array  index  given  as  i=k/b  where  i  is  the  index,  k  is  the 
discrete  sample  number  and  is  the  bit  rate  of  the 
intelligence.  Similarly  another  index  j  is  generated  using  j®k/g 
where  f ^  is  the  chip  frequency  Generation  of  the  indices  is  the 
key  trick  in  this  simulation.  The  desired  signal  now  is  given  by 
the  equations: 


w**,,  =  Acos(2n/8k  +  UIk)  (4-5) 

(fcjj  =  Cx(i)  0  y(j)]TT  (4-6) 


p=n 


p=i 


where  i  and  j  are  indices  of  the  arrays  as  defined  earlier.  It 
is  an  important  point  to  note  that  the  signal  0**^  is  completely 
defined  by  the  parameter  p  =  /c» 

This  signal  is  not  really  a  simple  BPSK  signal  but  it  has  an 
additional  feature  of  spreading  the  spectrum  by  controlling  the 
chip-frequency  and  carrier  frequency  and  baud-rate.  The  block 
diagram  of  the  scheme  is  given  in  Figure  4-1.  The  desired  signal 
y,^  is  given  by: 


Vk  "  “k  ^k 


(4-B) 


Where:  is  the  narrow  band  BPSK  signal  placed  at  different 
parts  of  the  frequency  spectrum  and  is  the  broad  band  BPSK 
signel  generated  for  a  specific  p  value. 


4.4  Frequency  Shi^t  Keying  Sequence 

benerating  this  sequence  needs  a  random  binary  intelligence 
signal.  This  was  once  again  achieved  by  passing  a  uniformly 
distributed  noise  through  a  hard  limiter.  The  output  of  the  same 
stored  in  an  array  x.  An  index  i  is  chosen  such  that  i*k/j,  where 
/fa  baud-rate  of  the  information  and  k  is  discrete  sample 

number.  Now  the  desired  signal  is  generated  via: 


Sk 

=  2cOS  (5,^  )  -  S,,_2 

(4-9) 

=  6  +  ^x  (i ) 

(4-10) 

Yk 

II 

in 

+ 

X 

(4-11) 

where  6  is  the  carrier  frequency  and  c  is  the  depth  of  the 
frequency  modulation.  Initial  conditions  are  very  important  and 
they  are  chosen  such  that  s_j=0  and  s_2=-sin(5)  giving  an  unit 
amplitude  sinusoidal  signal. 


4.5  Simulation 

The  adaptive  filter  algorithm  as  described  in  the  previous 
chapters  will  now  be  simulated  and  tested  using  synthetic  data 
generated  as  described  in  the  last  sections.  These  simulations 
were  carried  out  on  a  VAX  11/785  computer  and  were  written  in 
Fortran  77.  Further  details  on  these  simulations  can  be  found  in 
reference  C123.  The  adaptive  filters  used  are  the  Kwan  and 
Martin  filter  and  the  modified  Kwan  and  Martin  filter  (new 
algorithm)  as  described  in  chapters  2  and  3.  The  key  parameters 
of  these  filters  are: 


(a)  Sharpness  of  the  notch  filter  defined  by  pole 
position  <r^  =  l-kj) 

(b)  Step  size  in  the  incrementation  procedure  (/l) 

(c)  Time  constant  of  the  fading  filter  (X) 

(d)  Model  order  (n) 

(e)  Order  of  incoming  signal  or  number  of  interferers  (m) 
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4.5tl  Fading  Filter 

In  order  to  track  the  time-varying  parameters  it  is  essential 
to  compute  (l/N)J]je  j,  over  some  period  of  time  and  this  can  be 
essentially  achieved  by  a  simple  averaging  -filter: 

~  ^^k-i  +  <1  "  >^>6*  (4-12) 

with  a  time  constant  k  and  this  is  mostly  referred  to  as  the 
forgetting  factor  or  fading  factor,  (NOTE:  This  is  equivalent 
to  the  first-order  forgetting  of  equation  3-9b.) 

The  algorithm  was  fine  tuned  for  the  factors  (b)  and  (c)  by 
using  pure  sinusoidal  signal.  This  was  achieved  by  manually 
optimizing  u  and  X.  The  value  of  fi  was  chosen  as  0.01  and  X=0.9. 

After  fixing  the  values  of  u  and  X  the  algorithm  was  tested 
using  Narrow  Band  Noise  signal  y^  for  its  performance.  This 
signal  was  used  only  to  tune  the  value  of  r  (i.e.  sharpness  of 
the  notch  filter).  It  was  observed  that  if  the  value  of  r  is 
close  unity  variance  of  the  parameter  k\  estimate  increases. 
Based  on  simulation  the  value  of  r  was  chosen  as  0.9. 


4.5.2  Check  VAX  version  against  IBM-PC  version 

Under  these  parameter  conditions  BPSK  signal  y,,  was  applied 
to  the  adaptive  algorithm.  Figure  4-2  shows  the  block  diagram  of 
the  new  filter  that  will  be  tested  in  this  chapter.  Other  than 
notational  changes,  this  is  the  same  as  Figure  2-4.  Figure  4-3 
shows  the  results  of  a  sine-wave  test  like  was  described  in 
chapter  3.  The  purpose  of  this  test  was  to  verify  that  the  VAX 
version  of  the  program  gave  the  same  results  as  the  IBM-PC 
version  used  in  the  previous  sections.  Figure  4-3a  was  the  input 
consisting  of  three  sine  waves  in  the  presence  of  noise,  but  no 
BPSK  signals.  Figure  4-3b  is  the  filtered  output,  demonstrating 
that  the  filter  did  remove  the  sine  waves.  Figure  4-3c  shows  the 
parameter  adaptation.  By  making  a  detailed  comparison  of  this 
example  on  both  the  VAX  and  the  IBM-PC,  we  were  able  to  verify 
that  the  VAX  program  was  working  the  same  as  the  IBM-PC  program. 


Figure  4-2.  Block  Diagram  of  New  Algorithm. 
(NOTE:  Same  as  Figure  2-4,  except  for  notation) 
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100  200  300  400 


Input  . Sinusoidal  signals 

Number  of  Interferers  ...3 
Samples  per  carrier  cycle  of  the 

Interferers  . 12.0,4.5,3.0 

Variance  of  the  noise  . 1.0 

Adaptive  filter  step  ....0.02 
Adaptive  filter  r  . 0.9 
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4.5.>>  Elimination  of  narrow~band  BPSK  interference 

Our  next  experiment  was  designed  to  see  how  the  new 
algc‘-ithm  performed  on  narrow-band  BPSK  signals  rather  than  sine 
wave  interferers.  Figure  4-4a  shows  the  input  consisting  of 
three  narrow-band  BPSK  signals  at  the  same  frequencies  as  the 
sine  waves  in  Figure  4-3a.  Figure  4-4b  shows  the  filtered  output 
verifying  that  the  new  filter  is  able  to  eliminate  narrow-band 
signals  as  well  as  sine  waves.  Figure  4-4c  shows  the  parameter 
adaptation  for  this  case  and  should  be  compared  to  Figure  4-3c. 


4.5.4  Transient  behavior  (tracking  a  moving  interferer) 

The  transient  behavior  of  the  adaptive  filter  was  tested  by 
generating  an  FSK  signal  using  the  hardware  of  Figure  4-1.  The 
FSK  signal  is  similar  to  the  BPSK  signal,  but  the  spectrum  is 
constantly  changing.  In  our  example,  the  spectrum  switched  back 
and  forth  between  two  frequencies.  Figure  4-5a  shows  the  FFT  of 
the  input  signal.  From  Figure  4-5a  we  can  see  the  two  distinct 
frequencies  that  the  input  is  changing  between.  Figure  4-5b 
shows  the  output  spectrum  which  has  been  essentially  cleaned  of 
the  interfering  signal.  Figure  4-5c  shows  the  parameter 
adaptation  moving  between  two  values.  When  compared  to  the  input 
time  sequence,  we  were  able  to  verify  that  the  algorithm  was 
tracking  the  FSK  signal  and  eliminating  it  extremely  well  C10]. 


4.5.5  Elimination  of  narrow-band  BPSK  from  broad-band  BPSK 

Our  next  experiment  was  aimed  at  eliminating  narrow-band 
BPSK  interference  from  a  broad-band  BPSK  signal.  Figure  4-6a 
shows  the  input  consisting  of  three  narrow-band  BPSK  signals 
interfering  with  a  broad-band  BPSK  signal  in  the  presence  of 
white  Gaussian  noise.  All  of  the  signals  have  the  same  energy 
content.  Figure  4-6b  shows  the  output  spectrum.  Comparing  this 
with  the  desired  BPSK  signal,  we  were  able  to  verify  that  the  new 
algorithm  eliminated  the  noise  without  adversely  effecting  the 
signcl  [10].  Furthermore,  we  processed  this  signal  using  the 
Cyclic  Spectral  Analysis  Software  Package  C13]  and  obtained  the 
output  shown  in  Figure  4-7.  This  output  was  as  expected  and 
confirmed  that  the  new  adaptive  notch  filters  were  performing 
well  [12]. 
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Figure  4-5.  Tracking  oi  an  FSK  Signal  in  Noise. 
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ilr. 


Figure  4-6.  Filtering  Narrow-Band  BPSK  -from  Broad-Band 
BPSK  signal  in  white  Gausian  Noise 


b.  Broad-Band  BPSK  Corrupted  with  Interference  and  Noise 


Figure  4-7.  Processing  with  Cyclic  Spectral  Analysis  Software 
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4.5.6  Performance  with  too  many  notches 

One  situation  of  great  concern  was  what  would  happen  if 
there  were  too  many  notches  for  the  number  of  interfering 
signals.  Would  the  remaining  notches  attempt  to  eliminate  the 
broad~band  BPSK  signal ^  and  if  so  would  this  effect  the  Cyclic 
Spectral  Analysis  Software  Package.  Figures  4-8  and  4-9  address 
this  important  issue.  In  Figure  4—8  there  are  two  interferers 
and  three  notches  and  in  Figure  4-9  there  is  only  one  interferer 
and  three  notches.  As  before,  Figure  4-8a  shows  the  input 
spectrum,  Figure  4-8b  shows  the  output  spectrum,  and  Figure  4-8c 
shows  the  parameter  adaptation.  As  can  be  seen  in  Figure  4-8c, 
the  remaining  notch  wanders  around  the  frequencies  of  the  main 
lobe  of  the  broad-band  BPSK  signal  attempting  to  cancel  it. 
However,  since  the  notch  is  very  narrow  compared  to  the  main  lobe 
of  the  broad-band  BPSK  signal,  the  notch  is  unable  to  eliminate 
any  significant  amount  of  signal  energy.  Thus  when  we  applied 
the  Cyclic  Spectral  Analysis  Software  Package,  we  got  the  same 
results  as  Figure  4-7  C10].  A  similar  result  was  found  in  Figure 
4-9.  The  two  remaining  notches  in  Figure  4-9c  wander  around  the 
main  lobe  of  the  broad-band  BPSK  signal,  but  are  unable  to 
eliminate  any  significant  amount  of  signal  energy.  Thus  when  the 
Cyclic  Spectral  Analysis  Software  Package  was  applied,  we  once 
again  got  the  results  of  Figure  4-7  C10]. 


4.6  Conclusions 

The  BPSK  signal  y,j  was  given  as  input  to  the  new  algorithm 
and  the  results  showed  that  the  new  adaptive  notch  filters  were 
able  to  perform  well  under  various  situations  expected  in  the 
real  world.  The  new  algorithm  consistently  fared  well  in  its 
mission  and  was  able  to  prepare  the  incoming  data  for  processing 
by  the  Cyclic  Spectral  Analysis  Software  Package. 
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Model  misnatch  m-2  and  d*3 

Input  . DS-BPSK 

Number  of  Interferers  ...2 
Samples  per  carrier  cycle  of  the 

interferes  . 12.0,3.0 

Samples  per  Chip  bit  of 

interferers  . 200.200,200 

Broad  band  signal  samples  per 

carrier  cycle  . 4.0 

Broad  band  signal  samples  per 

chip  bit  . 8.0 

Adaptive  filter  step  ....0.02 
Adaptive  filter  r  . 0.9 


Figure  4-8.  Two  Inter-ferers  and  Three  Notches 
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Figure  4-9,  One  Inter-ferer  and  Three  Notches 


5.0  Conclusions 


-In  this  report  we  have  taken  a  care-ful  look  at  the  possible 
solutions  to  the  problem  o-f  eliminating  narrow-band  interference 
in  h road-band  communications  systems  in  the  presence  of  white 
Gaussian  noise.  We  have  come  to  the  following  important 
conclusions: 


1.  Of  the  many  possible  algorithms  available  for  solving 
this  problem,  only  two  seem  to  meet  the  requirements 
and  also  be  feasible  in  terms  of  hardware  complexity 
and  hardware  speed.  These  two  approaches  are: 

a.  adaptive  second-order  notch  filters  based  on  a 
modified  Kwan-Martin  approach  or 

b.  an  approach  based  on  the  DFT. 

2.  This  report  has  studied  carefully  the  adaptive  notch 
filter  approach  based  on  a  modification  of  Kwan  and 
Martin  and  found  it  to  be  extremely  well  suited  to  the 
problem. 

a.  Single  interferers  are  eliminated  within  at  most  a 
few  hundred  iterations, 

b.  With  multiple  interferers,  the  first  notch  will 
eliminate  one  of  the  interferers  within  a  few 
hundred  iterations  and  other  notches  kick  in 
quickly  such  that  as  many  as  ten  interferers  can 
be  eliminated  in  as  few  as  50B  iterations, 

c.  When  there  are  fewer  notches  than  interferers, 
notches  can  be  designed  using  proper  forgetting 
filters  to  either  eliminate  the  maximum  number  of 
interferers  or  to  attempt  to  reduce  all 
interferers  while  eliminating  some  of  them, 

d.  When  there  are  more  notches  than  interferers,  the 
extra  notches  do  not  adversely  effect  the  broad¬ 
band  signal , 
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e.  Notches  track  well  changing  interferers  and  are 
able  to  handle  -frequency  jumps  that  are  less  than 
one  order  o-f  magnitude  lower  in  -frequency  than  the 
inter-ferer  signal  -frequency, 

-f.  Single  notches  can  eliminate  two  or  more 

interferers,  i-f  those  inter-ferers  are  close 
together,  and 

g.  The  new  algorithm  is  easily  implemented  on  and 

IBM-PC  or  a  VAX  computer  and  seem?  well  suited  -for 
hardware  implementation. 


5.1  Brie-f  Look  at  Hardware  Feasibility 

Although  hardware  design  is  beyond  the  scope  o-f  this  report, 
we  shall  look  brie-fly  at  possible  hardware  con-figurations  in 
order  to  satis-fy  ourselves  that  the  algorithm  is  -feasible  -for  the 
desired  application.  Ideally,  we  would  like  to  design  a  5  to  10 
notch  -filter  that  would  operate  at  sampling  -frequencies  up  to  100 
MHz.  With  currently  available  technology,  about  the  best 
available  commercially  today  would  be  10  to  20  MHz.  In  what 
•follows,  we  shall  attempt  to  justi-fy  this  10-20  MHz  -figure  and 
discuss  how  through  the  use  o-f  pipelining  we  could  increase  this 
sampling  rate  to  as  much  as  eight  times  the  basic  sampling  rate 
(ie:  80-160MH2). 


5.1.1  Commercially  Available  Hardware 

In  our  investigation  o-f  the  hardware  -feasibility  o-f  a  10-20 
MHz  sampling  rate  modi-fied  Kwan-Martin  -filter  with  5  to  10  notch 
•filters,  we  shall  look  at  -five  commercially  available  DSP  chips: 


1.  MIPS  R3010,  40ns  cycle,  2  cycle  add,  5  cycle  multiply, 
and  19  cycle  divide  C143, 

2.  Weitek  3364,  50n5  cycle,  2  cycle  add,  2  cycle  multiply, 
and  17  cycle  divide  (30  cycle  square  root)  C143, 


3.  Texas  Instruments  TI  8847,  30ns  cycle^  2  cycle  add,  3 
cycle  multiply,  and  11  cycle  divide  (14  cycle  square 
root)  [143, 

4.  AT8<T  DSP32c,  20ns  cycle,  2  cycle  add,  2  cycle  multiply, 
and  3  cycle  divide  C153,  and 

5.  Honeywell  HDSP  66110,  80ns  cycle,  performs  vector  dot 
product  of  8  elements  for  an  effective  10ns  multiply 
and  accumulate  time  [163. 


The  first  four  chips  are  of  similar  architecture  and  thus 
could  be  implemented  using  the  same  block  diagram.  The  Honeywell 
chip  is  really  an  array  processor,  and  would  require  us  to 
vectorise  the  algorithm  to  take  advantage  of  its  speed.  Although 
we  believe  that  this  vectorization  could  be  done,  it  is  beyond 
the  scope  of  this  report,  so  we  shall  concentrate  our  attention 
for  the  time  being  on  the  other  four  chips. 

Figure  5-1  shows  the  block  diagram  for  implementing  a 
second-order  filter  using  one  of  the  first  four  DSP  chips.  The 
block  diagram  makes  use  of  a  coefficient  memory  which  can  be  set 
by  and  external  device.  Multiplication  A  is  done  in  parallel 
with  Multiplication  B  and  additions  are  done  in  sequence.  The 
second-order  building  block  of  Figure  5-1  is  used  in  Figure  5-2 
to  obtain  one  section  of  the  modified  Kwan-Martin  Filter.  This 
can  then  be  repeated  for  all  sections  and  results  in  a  very 
regular  structure  as  indicated  in  Figure  5-3.  In  the  process  of 
designing  this,  it  was  realized  that  an  additional  advantage  of 
the  modified  algorithm  over  the  original  Kwan-Martin  algorithm  is 
that  the  original  algorithm  could  not  be  broken  down  into 
identical  blocks  because  of  the  need  for  the  cascade  chain  in 
calculating  the  filter  derivative  C103. 


5.1.2  Time  Budget 

The  details  of  the  time  budget  have  been  worked  out  in  the 
M.S.  Thesis  C103.  The  result  is  that  the  best  floating  point 
processing  for  the  first  four  chips  is  achieved  with  the  AT8«T 
DSP-32C  which  yields  a  sampling  rate  of  5  MHz.  This  is  not 
sufficient  to  meet  our  10-20  MHz  design  requirement.  However, 
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2nd  Order  HR  Filter 
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Figure  5-1.  Block  Diagram  of  2nd  Order  HR  Filter 
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Basic  Building  Block 
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Fig  5.2 


2.  Block  Diagram  of  Basic  Building  Block 
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3-Notch  Canceller 
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Figure  5-3 


Block  Diagram  for  3-Notch  Cancel er 


this  was  done  without  pipelining  the  HR  section.  Using  the 
pipelining  techniques  of  Soderstrand  and  Uoomis  C 17-21 3,  we  would 
multiply  this  sampling  rate  by  at  least  two  and  probably  -four 
resulting  in  the  desired  10-20  MHz  design.  Furthermore,  if  we 
were  to  vectorize  the  algorithm,  the  Honeywell  chip  could 
potentially  yield  100  MHz  sampling  with  both  vectorization  and 
pipelining.  Based  on  this  hardware  analysis,  we  feel  confident 
that  sampling  rates  of  25  MHz  or  more  can  be  achieved  in  practice 
with  commercially  available  DSP  chips  or  most  certainly  with  a 
custom  VLSI  design. 


5.2  Future  Work 

There  are  two  avenues  of  future  work  that  should  be  pursued 
before  making  a  hardware  commitment  for  the  narrow-band  filter 
project: 


1.  DFT  based  approaches  to  the  problem  should  be  studied, 
especially  in  view  of  the  availability  of  high-speed 
FFT  processors  and  such  exotic  approaches  at  recursive 
DFT's  using  ORNS  arithmetic  C9],  and 

2.  a  detailed  investigation  of  hardware  implementations  of 
the  modified  Kwan-Martin  algorithm  should  be  made 
including  simulation  and  layout  of  a  custom  VLSI 
approach.  Because  of  the  regularity  of  the  structure 
in  Figures  5-1  though  5-3,  the  custom  VLSI  may  well 
yield  some  very  excellent  filters. 
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